ON A DIFFERENCE OF JENSEN INEQUALITY AND ITS 
APPLICATIONS TO MEAN DIVERGENCE MEASURES 
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Abstract. In this paper we have considered a difference of Jensen's inequality for 
convex functions and proved some of its properties. In particular, we have obtained 
results for Csiszar [5] /—divergence. A result is established that allow us to compare two 
measures under certain conditions. By the application of this result we have obtained a 
new inequality for the well known means such as arithmetic, geometric and harmonic. 
Some divergence measures based on these means are also defined. 



1. Jensen Difference 

Let 



Pi 



>0,^ Pi = l L n>2, 



t=i 



be the set of all complete finite discrete probability distributions. 

Let / :/ cR->Rbea differentiable convex function on the interval I, Xi E I (I is 
the interior of I). Let A = (Ai, Ai, A n ) E T n , then it is well known that 

(n \ n 

i=l J i=l 

The above inequality is famous as Jensen inequality. If / is concave, the inequality sign 
changes. 

Let us consider the following Jensen difference: 

n / n 

(2) iW>*) = £V(*i) -/(!>' 

i=l \ i=l 

Here below we shall give two theorems giving properties of Jensen difference. 
Theorem 1. Let f : I C R — > R be a differentiable convex function on the interval I, 

o o o 

%i E I (I is the interior of I), A = (Ai, Ai, A n ) G T n . If rji, r) 2 E I and rjx ^ Xi ^ fj2, 
Vz = 1,2, ...,n, then we have the inequalities: 

(3) ^ F f (X, X) ^ L f (X, X) ^ Z f ( Vl , V2 ), 
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where 

(4) 

and 
(5) 



L f (x, x) = j2 woo - XiXi E A * /,( 



i=l 



t=l 



,i=l 



Z/fai,i») = l(V2-Vi)[f(V2)-f'(Vi)}- 



The above theorem is due to Dragomir JU]- It has been applied by many authors 
|9].[T3]. The measure F(X,X) has been extensively studied by Burbea and Rao [311]. As 
a consequence of above theorem we have the following corollary 

Corollary 1. For all a,b,v,u G (0, oo), the following inequalities hold: 

va + ufr 



(6) 



() ^ vf(a) + ujf(b) _ 



V + UJ 



v + UJ 



vaf(a) + ubf'(b) fva + ub\ fvf'{a) + uf'(b) 



V + UJ 



V + UJ 



V + UJ 



^-(b-a) (f'(b)-f'(a)). 



Proof. It follows from Theorem ^ by taking Ai = jt^, A2 = A 
X\ = a, x 2 = b, x 2 = ... = x n = 0. 

Now we shall give some examples of Theorem ^ 
Example 1. For all x G (0, 00) , let us consider a function 

5^0, 



A n = 0, 
□ 



(7) 



/.(*) 



— Inx, s — 0. 

We can easily check that the function f s {x) is convex in (0, 00) for all s ^ 1. Let there 
exist rji and 7] 2 such that 7/1 ^ Xj ^ n 2 , Vz = 1,2, ...,n. Applying Theorem^ for the 
function f s (x), we have 

(8) ^ F S {X,X) ^ 3,(771,7/2), s ^ 1, 



where 



(9) 



F S (X,X) = { 



In 



E ^ - E 

i=l / i=l 



I G(A,X) 



8 = 0. 



(10) 

(11) 



A(A,X) = ^A,x i 

8=1 

n 

G(A,X) = n^ 



i=l 
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and 
(12) 

In particular we have 
A(X,X) 



Z s (a,{3) = -( V2 -r ]l )(r ] r 1 - V °- 1 ). 



(13) 



G(X,X) 



^ exp 



Vi ^ x i ^ V2, Vz = 1,2, ..n. 



The result (|13|) is due to Dragomir ^Uj. The following proposition is a particular case 
of the inequalities (jHJ) and gives bounds on Burbea and Rao's |3J H] Jensen difference 
divergence measure. 



Proposition 1. Let f : (0, oo) 

P,Q G T n , we have 



be a differentiable convex function. Then for all 



(14) < 



i=l 



f&i) + /(ft 



/ 



Pi + ft 



1 ™ 



i=i 



Proof. Take a> = f = \ in ©, we get 

(M) <M+M .) [/<(„) -/»]. 

Replace in (fT5]). a by and 6 by q iy and sum over alH = 1, 2, n, we get the required 
result. □ 

Example 2. Le£ its consider a convex function 



[s(s - 1)] 1 [x s - 1 - s(x - 1)] , s ^ 0, 1, 
x — 1 — In x, s = 0, 

1 — x + xlnx, s = 1, 



(16) 



(j) s (x) 



for all x G (0, oo) and s G (— oo, oo). Then from U^jj , we get 



(17) 

where 



0^W s (P\\Q)^-V s (P\\Q), 



I S {P\\Q) = [s(s - I)]" 1 E 



i=i 



(£i±2i) s , s ^ ,l, 



18) W,(P||Q) = <^ 



7 (P||Q)=ln 



n 

i=l 



I{P\\Q) = H (£±fl) 



P+Q \ _ H(P)+H(Q) 

2 - 



s = 0, 



3 = 1, 
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and 



(19) V.(P||Q) = { MP\\Q) = E 



J S (P\\Q) = I ± r) Z(p t - ft ) (ps-l - gfl) , S ^ 0, 1, 



J(P\\Q) = it(Pi-Qi)to (|): 



1. 



The expression H(P) = — E Ft In p i? appearing in (jl8j) is the well known Shannon's en- 



i=i 



irop?/. The expression J(P| |Q) appearing in (flUJ) is Jeffreys-Kullback-Leibler's J-divergence 
(ref. Jeffreys jTH] and Kullback and Leibler [E|). The expression (_P| | Q) is due to 
Burbea and Rao [3j. The measures (fT%|) and (flH|) has been studied by Burbea and Rao 
[3] only for positive values of the parameters. Some studies on these generalised measures 
can be seen in Taneja [T%1 I2U|. Here we have presented them for all s G (— oo,oo). The 
function given in (fTBj) is due to Cressie and Read [7j. 

Proposition 2. Let f : K + — > IR fre differentiable convex and normalized i.e., f(l) = 0. 
If P,Q G T n , are such that 0<r^| i ^P< oo ; Vi G {1, 2, n}, for some r and R with 
0<r^l^i?< oo, then we have 



(20) 
and 
(21) 

where 

(22) 



*C C f (P\\Q) ^ E Cf (P\\Q) ^ A Cf (r,R), 
^ C f (P\\Q) ^ B Cf (r,R) ^ A Cf (r,R), 



C f (P\\Q) = J2l^ 



i=l 



(23) 



Ec / (P\\Q) = Y t (Pi-gi)f 



Pi 



i=l 



(24) 



and 



(25) 



A Cf (r,R) = -(R-r) (f'(R) - f(r)) 



B c At, R) 



(R-l)f(r) + (l-r)f(R) 
R-r 



The inequalities (j2*Uj) follow in view of ©• The inequalities (|2*T|) follow in view of ©• 
For details refer to Taneja [221- The above proposition is an improvement over the work 
of Dragomir ^TJ^j. The measure (}2*2*|) is known as Csiszdr's [5] f-divergence. 
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Example 3. Under the conditions of Proposition^ the inequalities A2U\) and \21\) for the 
function Mb]) are given by 



(26) 
and 
(27) 
where 



(28) 



(29) 



(30) 



and 



(31) 



0^^ s (P\\Q)^E^(P\\Q)^A^ s (r,R) 
0^$ s (P\\Q)^Bs s (r,R)<A* s (r,R), 

K S (P\\Q) = [s(s - IF 1 



i=l 



*.(P\\Q) = lK(Q\\P) = f:< h \n (*), 
K(P\\Q) = ElHto(*\ 

i=l ^ ' 



s = 0, 



s = l, 



- 1)- 1 E (ft - ») * > 



s-l 



E* S (P\\Q) = { 



£ (ft- ft) In (|), 



S = l, 



(i?-r)(fi s - 1 -r s - 1 ) 
1 | 4(1=1) 



4 



i(/?-r)ln(f), s = l, 

a ^0,1, 



(,R-l)(r s -l)+(l--r)(fi s ~l) 
(R-r)s(s-l) 

(fl-l)lnl+(l-r)ln^ 
(ii-r) ' 

(R-l)rlnr+(l-r)i?.lnfl 
(R-r) 



8 = 0, 



8=1. 



The measure K(P\\Q) appearing in (}2*Hj) is the well known Kullback-Leibler's [17\ rel- 
ative information. The measure $ S (P||Q) given in (}2*Hj) has been extensively studied in 



Theorem 2. Let fa, f 2 : [a, 6] C 

iaere are a and (3 such that 



be twice differentiable functions on (a, 6) and 



(32) 



a < < P, VxG (a, 6), #(s) > 
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If Xi G [a, b] and A = (Ai, A 2 , A n ) G T n , then 
(33) aF f2 (X,X) <: F fl {X,X) <: (3F h {\X). 



(34) 

and 
(35) 



a [L h (A, X) - Ffy (A, X)] ^ L h (A, X) - F h (A, X) 

^p[L h (A,X)-F f2 (\,X)\ 



a [Z h ( Vl , V2 ) - F h (X, X)] ^ Z h {m, V 2) ~ F fl (X, X) 

^PiZf^^-Ff^X)} 

Proof. Consider the mapping g : [a, b] — > IR, defined by 

(36) g(x) = fx(x) - af 2 (x), Vx G [a, 6], 



where the functions f± and f 2 satisfy the condition ()32|). Then the function g is twice 
differentiate on (a, b). This gives 



and 



g'( x ) = f[( x ) -a/2 0*0 



nix) 



g"(x) = f»(x) - af' 2 \x) = ft(x) ( ^ - a ) > 0, Vx G (a, b). 



The above expression shows that g is convex on [a, b]. Applying Jensen inequality for 
the convex function g one gets 

/ n \ n 

g 53 A '< Xl ^ 53 Kg(xi), 



i=l 



i.e., 



i.e., 



(37) 



fi 53 X i x i ) ~ a h 53 ^ 53 Aj [/i( x *) ~ a /2(a:)], 



,i=i 



,i=l 



i=l 



a 



53 A */2(^) - /2 53 Ai 



•^7 



i=l 



i=l 



. i=l 



The expression fl3T|) gives the l.h.s. of the inequalities (J22J). 
Again consider the mapping k : [a, 6] — > R given by 

(38) k{x) = Pf 2 {x)-h{x), 

and proceeding on similar lines as before, we get the proof of the r.h.s. of the inequalities 
(HUH). 

Now we shall prove the inequalities (JH3J- Applying the inequalities (JHJ) for the convex 
function g given by (|HEJ), we get 

F g (X,X) ^L g (X,X) ^Z g ( Vl ,ri 2 ). 
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i.e., 

(39) F fl (X,X) - aF f2 {X,X) ^ L fl (A, X) - aL h (X,X) 

Simplifying the first inequality of (j3~9"|) we get 

(40) a [L h (A, X) - F h (A, X)\ < L fl (A, X) - F fl (A, X) . 
Again simplifying the last inequality of (jHSj) we get 

(41) a[Z A (^, % ) -F A (A,JC)] < Z fl (r)i,r)2) - F fl (X,X). 

The expressions ([471]) and (JJTJ) complete the first part of the inequalities (jBH) and ([33]) 
respectively. The last part of the inequalities (jMj) and (j3Hj) follows by considering the 
function k(x) given by (J3~%j) over the inequalities ©• □ 

Particular cases of above theorem can be seen in pQ, [Hj, [01, [II]- Applications of the 
above theorem for the Csiszdr's f- divergence are given in the following proposition. 

Proposition 3. Let fx, f 2 : J C 1R + — > K 6e £ioo normalized convex mappings, i.e., 
/i(l) = /2(f) — and suppose the assumptions: 

(i) fi and f 2 are twice differentiable on (r, R), where 0<r^l^R< 00; 

(ii) there exists the real constants a,/3 such that a < (3 and 

(42) a^lM^p, f»{z)>0, Vxe(r,R). 

/2O) 

If P,Q E T n are discrete probability distributions satisfying the assumption 

0<r«C — ^R<oo, 
Qi 

then we have the inequalities: 

(43) a C h (P\\Q) ^ C h {P\\Q) ^ (3 C h {P\\Q), 



(44) a [E h {P\\Q) - C h {P\\Q)\ ^ E fl (P\\Q) - C fl (P\\Q) 

^(3[E h (P\\Q)-C h (P\\Q)], 

(45) a[A h (r,R)-C f2 (P\\Q)] < A h (r, R) - C h {P\\Q) 

^P[A f2 (r,R)-C f2 (P\\Q)) 

and 

(46) a[B h {r,R)-C h {P\\Q)]^B h {r,R)-C h {P\\Q) 

^P[B f2 (r,R)-C f2 (P\\Q)). 

Proof. It is an immediate consequence of the Theorem El □ 
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2. Applications to Mean Divergence Measures 
Let us consider the following mean of order t: 



l/t 

i a- -to- i 

\4 J 

(47) D t (a,b)={ 



t^O, 

ab, t = 0, 



max{a, 6}, £ = oo, 
min{a, 6}, t = — oo, 



for all a,b > and tel. In particular, we have 

2 2ab 



D_ x (a, 6) = //(a, 6) = = = ^a" 1 , ft" 1 )" 1 

a + 6 a + " 

D (a, 5) = G(a, b) = Vab = y/A(a,b)H(a,b), 
D 1/2 (a,b)=N 1 (a,b)= ( ^ + ^~ b \ =A^,Vb^ 



and 



Di(o,6) = A(o,6) = ' M 



2 ' 

where H(a,b), G(a,b) and A(a, 6) are the well known harmonic, geometric and arith- 
metic means respectively. It is well know [2j that the mean of order t given in (|47J) is 
monotonically increasing in t, then we can write 

D.i(a,b) < D (a,6) < D 1/2 {a,b) ^ Z>i(a,6), 

or equivalently, 

(48) H(a, b) < G(a, 6) < iVi(a, 6) < A(a, 6). 

We can easily check that the function fix) = — x 1 ^ 2 is convex in (0, oo). This allows us 
to conclude the following inequality: 



(49) Va + Vb ^ [aTb 

From (|49|). we can easily derive that 

2 



(5Q) J^WSj ^ l^aWi^ ^ « + 6 

Finally, the expressions (}4*5j) and (|50p lead us to following inequalities: 
(51) i?(a, 6) < G(a, 6) ^ iVi(a, 6) < JV 2 (a, 6) sC A(a, 6), 

where 

jV 2 (a,&) = 



\/o + yfb \ ( a + b 
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Let P,Q G r n . In (|51j) . replace a by pj and 6 by sum over all i = 1,2, ...n we get 

(52) < G(P||Q) < Ni(P\\Q) ^ N 2 (P\\Q) <: 1. 

Based on inequalities (f5*2*|) . we shall build some mean divergence measures. Let us 
consider the following differences: 

(53) M AG (P\\Q) = 1-G(P\\Q), 

(54) M AH (P\\Q) = 1-H(P\\Q), 

(55) M^ 2 (F||Q) = l-iV 2 (F||Q), 

(56) M N2G {P\\Q) = N 2 {P\\Q) - G(P\\Q), 

and 

(57) M N2Nl (P\\Q) = N 2 (P\\Q) - N^PWQ). 
We can easily verify that 

(58) M AG (P\\Q) = 1 - G(P\\Q) 

= 2 [N^PWQ) - G{P\\Q)\ := 2M NlG (P\\Q) 
= 2[1-N 1 (P\\Q)] :=2M ANl (P\\Q). 

(59) 

We can also write 

(60) M AG (P\\Q) = 1 - G(P\\Q) := h{P\\Q) 
and 

(61) M^(P||Q) = 1 - H(P\\Q) := ^A(P||Q), 

where h(P\\Q) is the well known Hellinger's [T^] discrimination and A(P||Q) is known 
by triangular discrimination. These two measures are well known in the literature of 
statistics. The measure Man 2 {P\ \Q) is new and has been recently studied by Taneja 



Now we shall prove the convexity of these measures. This is based on the well known 
result due to Csiszar [SUHj- 

Result 1. If the function f : M + — > R is convex and normalized, i.e., f(l) = 0, then the 
f-divergence, Cf(P\\Q) is nonnegative and convex in the pair of probability distribution 

(p,Q)er n xr n . 

Example 4. Let us consider 

(62) fAH{x)=i ^Yy xe ^°°^ 

in J23P, then C f (P\\Q) = M AH (P\\Q), where M AH (P\\Q) is as given by CT- 
Moreover, 

(x-l)(x + 3) 



r, 



AH 



X 



2(x + l) 2 
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and 

(63) f'; H (x) = — ^ > 0, x G (0, oo). 
Example 5. Let us consider 

(64) /ag(x) = ^(v^-1) 2 , 16(0,00), 

m (01), tfaen C/(P||Q) = M AG (P\\Q), where M AG (P\\Q) is as given by (E3J). 
Moreover, 

f ' AG{x) = 

and 

(65) f; G (x) = ^-L= > 0, xG(0,oo). 

Example 6. Let its consider 

f ( \ ( x+ l )V 2 ( x + l)-l-x-2y^ 

(66) fN 2 NA x ) = ^ ) x e (0, oo) 

m < f73)) . inen we nave C/(P||Q) = M N2Nl (P\ \Q), where M N2Nl (P\\Q) is as given by (f57p . 
Moreover, 



, , . _ 2x + 1 + y/x" - (y/j + 1) y/2(x + 1) 

6v/i(x + l) 2 

and 

-2x - 2x 5 / 2 + x(2x + 2) 3 / 2 



(67) f^ Nl {x) 



8x 5 / 2 (2x + 2) 3 /2 
x [(2x + 2) 3 / 2 - 2(x 3 / 2 + 1)] 



8x 5 / 2 (2x + 2) 3 / 2 

Since (x + 1) 3/2 ^ x 3/2 + 1, Vx G (0, oo) and 2 3/2 ^ 2, £/ien obviously, fh 2Nl {x) ^ 0, 
Vx G (0,oo). 

Example 7. Lei its consider 

f ( \ (v^+1) y/2(x+l)-4x 

(68) /at 2 g(x) = , x G (0, oo), 

in (03), inen C f (P\\Q) = M N2 q(P\\Q), where M N2G (P\\Q) is as given by ER) . 
Moreover, 

,, , , 2x + l + v^-2v/2(x + l) 

/ x = — 

Jn * gK ' 4^2x(x + 1) 

and 

(2x + 2) 3 / 2 - x 3/2 - 1 

(69) f '^ x) = 4x 3 / 2 (2x + 2) 3 / 2 ' 

Smce (x + 1) 3/2 ^ x 3/2 + 1, Vx G (0, oo) and 2 3/2 ^ 1, iaen obviously, f^ G {x) ^ 0, 
VxG(0,oo). 
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Example 8. Let us consider 



(70) fAN 2 {x) = - , x G (0,oo), 

in (3.1), then C f (P\\Q) = M AN2 (P\\Q), where M AN2 (P\\Q) is as given by 155)). 
Moreover, 

, ( 2X + 1 + y/x - 2y/2x(x + 1) 

and 

1 + x 3 / 2 
8x 3 / 2 (x + 1)^ + 2 



(71) /W*) = ^ 7^=^ > 0. x e (°> °°)- 



In the above examples EHS] the generating function /r.)(l) = and the second derivative 
is positive for all x G (0, oo). This proves the nonegativity and convexity of the measures 
(J55j) -(|57 j) in the pair of probability distributions (P, Q) G T n x T n . 

The inequality (|H2*|) also admits more nonnegative differences, but here we have consid- 
ered only the convex ones. 

Based on the Proposition^ we can obtain bounds on the mean divergence measures, but 
we omit these details here. Now we shall apply the inequalities (jSljl given in Proposition 
1.3 to obtain inequalities among the measures (|53 |l - (j57jl . 

Theorem 3. The following inequalities among the six mean divergences hold: 

(72) ^M AH (P\\Q) < M N2Nl (P\\Q) < ±M NaG (P\\Q) 

^^M AG (P\\Q)<:M AN2 (P\\Q). 

The proof of the above theorem is based on the following propositions, where we have 
proved each part separately. 

Proposition 4. The following inequality hold: 

(73) ±M AH (P\\Q)^M N2Nl (P\\Q). 
Proof. Let us consider 

}'aH\ X ) 



(74) 9ahm 2 nAx) - , „ ( v 

JN 2 Ni\ X ) 

32x 5 / 2 (2x + 2) 3 / 2 

x G (0,oo) 



(x + l) 3 [-2x - 2x 5 /2 + x (2x + 2) 3 / 2 ] 
where f AH (x) and f'^ 2N (x) are as given by and (|57|) respectively. 



12 



INDER JEET TANEJA 



From (|74|) . we have 

48 v /2x(x+ 1) 



9ah.n 2 n x 1 



x 



(x + l) 4 [-2x - 2x 5 /2 + x (2x + 2) 3 / 2 ] 2 
x [4x 2 (l - x 5/2 ) + x 2 (x - l)(2x + 2) 5/2 ] 
48x 2 (x + 1) (1 - ^/x) ^2x(x + 1) 
(x + l) 4 [-2x - 2x 5 / 2 + x(2x + 2) 3 / 2 ] 2 

(Vx + l) (X + 1) 3/2 - (x 2 + X 3/2 + X + y/x + l) 

Since a/2(x+ 1) ^ ^/x+ 1, Vx G (0, oo), then 

V2(x + lf /2 (Vi+1) ^ (v^+l) 2 (^ + l) 

^ x 2 + x 3/2 + x + \/x+ 1. 

Thus we conclude that 

/ 7K x / / x /< 0, X > 1, 

(75) ^W*)| >0> x<L 

In view of (|75|L we conclude that the function gAH_N 2 Ni( x ) is increasing in x G (0, 1) 
and decreasing in x G (1, oo), and hence 

(76) M = SUp gAH.N 2 NA x ) = S'AHJVaJViCl) = 8. 

xe(o,oo) 

Applying the inequalities for the measures Ma#(.P| |Q) and Mjv 2 iVi(-P||Q) along 
with (|75j) we get the required result. □ 

Proposition 5. T7ie following inequality hold: 

(77) M^ 1 (P||Q)^^M^ G (P||g). 
Proof. Let us consider 

(78) gN 2 N 1 M 2 G{x) 



/A r 2 A r i( X ) 
/at 2 g( X ) 

-2x - 2x 5 / 2 + x(2x + 2) 3 / 2 



2x [1 + x 3 /2 - (2x + 2) 3 /2] ' X E ( °' °°) 

where f'l} 2 ^ {x) an d f'N 2 G( x ) are as given by (JoTj) and (jBDj) respectively. 
From (|78|) . we have 



, 3x2v^T2(l- yg J < 0, x > 1, 

(79) ^j, aGl W - — — _ — - — - 2)3/2]2 j > Q x <1. 

In view of (JZHJ), we conclude that the function gN 2 N 1 .N 2 G(x) is increasing in x G (0, 1) 
and decreasing in x G (1, oo), and hence 

(80) M= SUp gN 2 NxJf 2 G{x) = 5JV 2 iViJV 2 G(l) = 7T- 

xe(o,oo) "J 
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Applying the inequalities f° r the measures M N2Nl (P\\Q) and M N2 q(P\\Q) along 
with (|8L)p we get the required result. □ 

Proposition 6. The following inequality hold: 

(81) M N2G {P\\Q)^M A g{P\\Q). 
Proof. Let us consider 

(82) <^ G (x) = = {2x - 2)3/2 , x G (0, oo), 

where f'^ 2 a( x ) and /^(x) are as given by (jo^j) and respectively. 
From (|82)1. we have 

(m s , / n _ 3(l-y^) f^O, x^l, 

^ ^ 2G -AG^J " (2x + 2)5/2 ^ Q x ^ 1. 

In view of (J83|) . we conclude that the function gAHM 2 Ni{ x ) is increasing in x G (0, 1) 
and decreasing in x G (1, oo), and hence 

3 

(84) M = sup g N2 G.AG(x) = 5at 2 g.ag(1) = t- 

xe(o,oo) 4 

Applying the inequalities (J33|) f° r the measures Mat 2 g(-P| |Q) and Mag{P\\Q) along with 
(jHl|) we get the required result. □ 

Proposition 7. The following inequality hold: 

(85) \m A g{P\\Q)^M AN2 {P\\Q). 
Proof. Let us consider 

(86) 9 AG-AN 2 (x) = = ^J^^ 2 ^' 1V x G (0, oo), 

/ajv 2 W (V^ + l)(a:-^+l) 

where f AG (x) and fAN 2 ( x ) are as given by (jHSJ) and (|7T|) respectively. 
From (|8f))l. we have 

, 3(l-v^)y^+2 /^0, x>l 

+ (x- v/x + 1) pO, X<1 

In view of (jKTj) . we conclude that the function Qag-ANi (x) is increasing in x G (0, 1) and 
decreasing in x G (1, oo), and hence 

(88) M = sup g A G-AN 2 {x) = 9ag.an 2 {^) = 4. 

16(0,00) 

Applying the inequalities f° r the measures M^g(P||Q) and Man 2 (P\\Q) along with 
we get the required result. □ 
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Combining the results given in the Propositions EH we get the proof of the theorem. 
The expression ()73|) can also be written as 

(89) ^A(PHQ) < M mNl {P\\Q) ^ ^M N2G (P\\Q) 

^h(P\\Q)^M AN2 (P\\Q). 

Remark 1. (i) The classical divergence measures I (P\\Q) and J(P\\Q) appearing in 
the Section 1 can be written in terms of Kullback-Leibler's relative information as 
follows: 



(90) I(P\\Q) = \ 
and 

(91) J(P\\Q) = K(P\\Q) + K(Q\\P). 
Also we can write 

(92) J(P\\Q)=4[I(P\\Q)+T(P\\Q)}, 
where 



(93) T{P\\Q) = \ 



is the arithmetic and geometric mean divergence measure due to Taneja |19j . 
(ii) Recently, Taneja |22] proved the following inequality: 

(94) ~A(P\\Q) ^ I(P\\Q) < h(P\\Q) ^4M AN2 (P\\Q) <: \j{P\\Q) < T(P\\Q). 
Following the lines of the Propositions 0[7| we can also show that 

(95) h(P\\Q)^M N2Nl (P\\Q). 

Thus combining fifty with fifty , fif^j and fifty , we get the following inequalities 
among the classical and mean divergence measures: 

(96) ^A(P||Q) ^ \l{P\\Q) ^ M N2Nl (P\\Q) 

< ±M N2G (P\\Q) ^ ~h{P\\Q) ^ M AN2 (P\\Q) 
<±J{P\\Q)<\t(P\\Q)^±J{P\\Q). 
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